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?he assessaent of the impact of large-scale educational programs. 
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larqer than one of what kind of achievement tests to use " It may be 
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better afcle tc deal with such problems as the following: 1) the 
nebi^lousness and variability of treatments, 2) the complex economic 
political, and social context in which the treatments are set, 3) the 
diversity of populaticns served and goals sought, 4) the 
reconciliation of necessary and sufficient conditions, and, 5) such 
limitations cf evaluative research technology as: program and 
population specification, program and population sampling, 
interchangeable and dialectical nature of the J^P f ^^^^ - 
indecendent variables, inappropriate ness of extant statistical 
ana!?^es for the study of the dynamic blending of variables by which 
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and, normative approaches to aggregate data m search of 
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Considerable static has been raised over the past several 
years about two related but distinct problems. I say static be- 
cause the disturbance signals have been fairly constant and 
ioud. but not very clear. We know some things are not right, 
^but we are not quite sure, what they are and are even less cer- 
tain about what ought to be done. The two related problems 
have to do with the following: 

1. the appropriateness of existing standardized tests ot 
^ achievement for the assessment of academic function 
in minority and disadvantaged group member students; 
and 

the appropriateness of such instruments for the asscss- 
_^ ment of the impact of large-scale educational programs. 

Let us turn our attention first to the problems that arise 
^when we try to apply normative approaches to assessment to 
the appraisal of educational achievement in disadvantaged 
and low-status minority populations. Concern with this prob- 
lem dates back at least to the forties when Davis and Eells 
sought approaches to assessment that were free of cultural 
loading^: As they discovered the futility of lheir efforts at 
developing tests that were culture free, they directed their 
search at the development of tests that were culture fair. 
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^1 A Criticai Review of 
Blad. Consdixnisness, Identity 
and Achievement"^ 



'""Joseph C. Grannis 



Patricia Gurin and Edgar Epps have conducted a major 
study of students in historically black southern colleges. 
Their book differentiates among both the stuaents and the 
colleges in powerful and subtle ways. It identifies important 
relationships between background and personality char- 
acteristics of the students and their, orientations to achieve- 
ment and activism, and it demonstrates interactions between 
key personal variables and features of the college environ- 
ments. By focusing on both the academic-occupational and 
the ''social-political aims and accomplishments of the students, 
Gurin and Epps have represented black concerns far more 
validly than attention to only one of these constellations of 
izoals can reveal. Theirs is the first empirical study to illumi- 
nate, if not to answer fmally, the que.stion Carmichael and 
Hamilton stated anew in Black Power (1967). whether 
individual achievement and collective accomplishment are in- 
compatible for blacks in the American system. 

Variable,s of the Study 

Nearly 5()(X) students were included altogether in a study 
of ten colleges in 1964-1965. a study in six of these colleges 
in 1970, and three longitudinal substudies of the students 
wh() were freshmen in one of the ten colleges in 1964-196,5 
(the class of 196S). It is only valid. to speak of these stu- 
dents in the past tense. The present tense, however, would 
better capture the first point that this book drives home. Black 
students vary along the same dimensions that have differcriti- 
iited n(mhlack students in other research. Just as Billingsley 
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These cttbrts. as \ou iii;i> recall, wcrv wunc siiccesslul. Init 
ihc insiruiucnls rcsiiliinu trnm ihcir work hail low preilic- 
livc value when subsecjuenl achieveiueiil iii acaileinie selliniis 
was I he refereni. 

As the civil and huiiian riizlus nu>\ emenls ol the l it lies 
and sixties advanced. addiliDnal allenlion was locused on 
the inappropriaieness ot siaiidardi/ed lesls li»r ihe assess- 
ment of iiiinnrily iiroup members, in this period, ii was not 
unusual lor psyehoiiielrieians in add ti\e to ntleen points lo 
the :j;C()res of minority subjects to eoiiipensale lor the assumed 
artificial depression in lest scores resullinu troiii the inap- 
pr(^Jiriatene,ss of the test. However, these added points were 
annved at arbitrarily and rellected an assumed cixunion and 
ur/iform depression in scores despite known dillerentials in 
the minority subjects' exposure lo and involvcinenl in the 
liiajority culture. The practice subsided as its illoiiic and 
its patroni/ini! character hecame heller recoLMii/ed. 

Other el torts have been directed at insurine (he inclusion 
ot" minority iiroup niembers in the populations on which 
the instruments are nornied. This procedure, however. onl\ 
sliLihtly reduces the iriip;ict of the majority izroup's dominance 
in the norminu procedure. .A more sensitive accominou*.» 
tion, of course, is the development ol [lopulation-specific 
ni>rms and the use of such norms in the inlerprelalion tit 
the data. However, ifiis priictice has been (.|ues!ioned since 
the reality standard is performance in competitive academic 
and work situations with majoritv Lirt)up members. This is also 
the criticism raised auainst population-speciilc instrumenta- 
tion. The speaker who follows me, Brother lioh Williiinis. 
has done pioneerinii work in the development of ;i test ot 
* 'black inielliuence," or j.iilier an achieveuicfit test, with bkick 
culture as the rclereni. I think Bob's data lead in to (he same 
problem we have with population-specific norms\ I 'nlcss and 
until the curricula and the criteria for inastcr\ are made more 
congruent with the purj^oscs and values of ihc taiiict [)t>pula- 
tions, the changed foci ot assessment will continue to have 
low predictive value. Or. to be more accurate, the trailiiional 
curricuhi will continue to he inappropriate to the assessed 
behavior and potentials of the target groups. With all of 
these efforts proving to be somewhat unsuccessful, ii is ni^t 
surprising that by the early h^7()\ some of us are calling 
tor a moratorium on (he use of si;indardi/'e(.j tests witj^ mi- 
nority group members. 

One could argue that what we h:ive here is ■. political 
rather than a psychometric problem. Ihis is especially likely 
to he the case so long as it appears (hat the (^hjccliiMi to the 
standardized tests is based on the fact that minority uroup 
members tei^d lo score less well than do majority group 
members. It is not so much the diftereniial in minority group- 
majority group scores that leads ine to question tlie ap- 
propriateness of standardized achievement tests and (he 
normative approach to their interpretation. hicre.*sipgly . 1 am 
persuaded not only that such instruments and procedures are 
inappropriate for the assessment of achievenn nl in miiniritv 
and disadvantaged populations, but also that traditional sian- 
ardized tests and normative approaches to assessment are 
dysfunctional and counterproductive to the purposes of 
pedagogy whenever we are contVonied with the problems 
i)f educating populations with diverse characteristics 



When we first turned to the problems of educating 
eilucalionally aiul social Iv tlisadvaiUai^cd children, a great deal 
of allenlion was given lo the s[)ecial characteristics of this 
population. The notions that dominated this new fiehl were 
largely determined hy conceptions of this population as 
homogencinis witli respect to conditions of life and be- 
havioral characteristics. We assu.ned a pervasiv(; "culture 
of poverty.*' The [>)pulation was largcK ulentifieil In its 
delictus in comparison with characteristics assumed to be- 
typical of the white middle class. Subsequent work and more 
caretiil study reveal that minority and disadvantaized chiklrei^ 
arc not a honuigeneous mass. In fact, there appears to be as 
much \arialioi^ wittiiir populations so dcsiiznalcil as there is 
iK'tween dis;rdvanlaged and more privileged groups. Diversity 
and heterogeneity, rather than deficiency and homogeneity, 
are now recognized as presenting the challenge. .*\nd, it 
is not only a challenge presented by children ol linv- 
slalus peoples: diversity in human characteristics increasingly 
is recognized as the central problem in pedagogical (.lesign 
for all peoples. 

[.earners differ in interests, in ci^gmtive style, m rale 
of learning, in patlenis of developed abilities, in motivalii)n, 
in work habits, and in temperament, as well as in ethnicity, 
sex, and social class. In fact, it may well he that our pre- 
occupation with such status and indicator variables as S1\S, 
sex, and ethnicity have retarded the scientific development 
of jicdagogy. 7"!ie differences associated with these status 
groups may h.ive much less relevance for the design of edu- 
cational treatments than do differences in behavioral function. 
When we .refer lo SliS, we are using an irulicator variable 
to imply the presence or absence of certain functional char- 
acteristics or circumstances that are presumed to intlucnce 
learnirig and development. But the exchani:e of sociali/a 
tion >lralegics across ,ShS designations makes social cl:is% a 
mrch less reliable indicator than we used lo think. As sex 
roles change and are interchanged, and as ethnicity is con- 
nMiUiici^l by social class, the specific characteristics of 
conditional and behavioral indivldualit\ provide belter levers 
for, or guides lo, educational planning. It is these character- 
istics ol conditional and behavioral individuality that make 
lor the pedagogicallv relevant dimensions (^f human iliversity. 
!l is these educationally relevant dimensions of diversity to 
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which cduciUlon iinisl he responsive. >'cl. il is LiMiduiiMi.il 
and behavioral iiidis idualiiy and divcrsiiv lhal nonnalivc 
and standardized approaches lo assessnienl ignore and, 
in large measure, arv desiuned lo avoid, l-or example, lesi 
ileitis are selected wilh a vieu toward ihcir capaciiv lo lap 
slable tiinelions, and hy slahle we usuallv mean ihose 
funelions less likely lo he intluenced h> siiualional or 
pcrsonalisiie variabiliiy. We demand lhal ihe ilcins he 
prescnied in slandardi/ed and unitorm eondilioiis lh;il are 
insensilive lo ditYereniial response tendencies. Phe daia vil 
, ihese lesls are analyzed lo retleci one's posiiion in relaliiMi 
lo a group norm ralher ihan lo retleci one's maslery ol ihe 
lask or ihe process hy which one engages ihe lask. il almosi 
looks as it' our lesls \vcre designed lo he ol no use lo leacheis 
since il is ihese processes of eiigagemen!. ihesc dilterenlial 
response lendencies. ihese siiualional and pcrsonalisiie 
variables lhal are ot crucial iiiiporiance in ihc design and 
ilianagcmenl of leaching and learning iransaclioiis. 1. iheie- 
fore, assert lhal noniialive and slandardi/ed approaches lo 
assessnienl arc nol only inappri>priale tor ihe assessnienl ot 
achievcmeni in minoriiy and disadv aniaged populalions. hui 
are also dysfunciional and counlcrproducli ve. lo pedagog) 

Glaser (I^)7()) idcniitlcd several reasons for ihc currcnl 
dissaiisfaclion wlih slandardizcd icsling. He referred more 
specifically U) lesls of iniclligcnL{\ hul his argumcnl is rc- 
icvani here, particularly since I view iiiiclligcncc tests as 
slighllv more refined tests of achievement, (ilascr wnMc: 
L The present operational definition of intcHigenee 

(achievemeni) measures seems to have reached a plateau 

or asvmpioie of efficiency with our present technology. 

The prediclivc validity of tests has not increased tor , 

some lime. 

2. Since tests esseniiully measure general scholastic apti- 
tude, ihey have not adequately recognized the dis- 
conlinuitv between the backgrounds and culnircs of 
certain groups in our society and the requirements tor 
succeediniz in the conventiuiuil education system. 

3. Tests retleci a restrictive overselccli\ e view of intel- 
liizence (achievement) that limits the educational sysrem 
in adapting lo sUkknts in order lo maximi/.c ihcir 
achievcnieni. In essence, the tests give go/no-go se* 
Icciive decisions but do not provide much deeper di- 
aizno.sis ior the conduct of education. 

4. There is recognition that test theory and technique ha\e 
nol made ctiniact with modern psychological theories 
of learning and cognition, and that test development . 
sht)uld be infiuenced hy new developments in these 
areas. Modem theory brings us close to understanding 
the components of cognitive functioning and can help 
us succeed in analyzing and understanding the detailed 
processes underlying intellectual abilities - the initial 
lask ihai.Binei set fiir himself, hut had to abandon. 

Why has the circumstance come about and why does it 
persist? Much of the impetus for the development of a techno- 
. logy of assessneni related to intellective function and achieve- 
ment resulted from, and has ^^cen maintained hy, a supply- 
and-deniand approach to acce to education and the dis- 
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irihution of educational opportunities. IVior to the twentieth 
centmy, access to a limited suppiv of educational i^ppoiiu- 
iiittes was guarded by selection procedures based iijion the 
prosfiective student's social status in the prc-Kcformalion 
period, access was limited to the political and religious 
nobilit), later it was limited to other privileged classes. 
Twenlietti-ceiilury selection procedures have come to be 
dominated b\ the student's dciiionstraled or predicted intel 
leclual status. Where the supply of opportunilies has been 
limited, great cmjihasis has been jilaced on the selection ot 
students and the prediction of their performance when exposed 
to those opptinunities. liinci's work in intelligence test de- 
velopment was directed toward the creation of an instrument 
that could he used to identify those pupils wlu^ were likely 
to benefit from schooling. His admonitions that we also turn lo 
trcatincn! ot those expected not to succeed were generally 
ignored. In a periiKl of scarce educational opportunities. 
Billet's concern for the educahility of intelligence did not 
\iA\n fa\or. Society tound greater utility in the promise ot 
the predictive and selective validity of his new test. 

I'his emphasis on selection and prediction has con 
tinned even though the social conditions'that gave rise to it 
hiivc changed. In recent years, we have seen in the U.S.A. 
a growing concern with universal access to education. Ihe 
educational product requireiiients of the nation arc more 
frequently coming to be defined in terms of our capability 
to provide postsecondary educational opportunities lor the 
majority of our youth and a continued program of learning 
for most of our citizens. If this trend continues, selection 
and prediction can no longer he allowed to dominate the 
techniilogy of psycho-educational appraisal: rather, the stage 
must be shared with an emphasis on (h'Mri/xion and prt'- 
scrifHum (i.e., the qualitative description of iiitelleciive 
function, leading nni to the selection of those most likely 
to succeed hut to the prescription of the learnmg experiences 
required to insure more adequately that academic success is 
possible ). 

The position being advanced here is that psychological 
testing obviously can be used to measure achieved develop- 
ment. Using those measureiiients, we can predict, w ith reason- 
able validity, subsequent achievement in the same dimensions 
of behavior under similar learning experience conditions. 
Thus, persons who have learned an average amount during 
one learning period (high school) may be ex[>ectcd to learn 
an average amount in the next learning period (college). 
However, we have not given adequate attention to the fact 
that psychoUigical testing can be used for the following pur- 
poses: (a) to describe and qualitatively analyze behavior 
function in order to gain a better understanding of the pro- 
cesses hy which achievement is developed, (h) {o describe 
nonstandard aLhicvemcnts that may be equally as functional 
in subsequent situations requiring adaptation, or (c) to specity 
the conditions in the interaction between learner and learning 
cqK-rience that may be necessary to change the quality of 
future achievements. 

If we are to approach such goals in achievement test- 
in*:, we will need to redress the imbalance made more ob- 
vious hy the growing recognition of individual and group 
difiercnces in function, on the one hand, contrasted with a 
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fairly untlift'crcnliatcd nicasurcnicni icchnoloizy on ihc oihcr. 
Uniil such progress is made, ihc louic o{ iny posilion lorccs 
mc lo endorse ihe eall tor a nioraioriuin on llie iradilional 
usages of standardized achievemeni lesiini: and iis norniaiive 
inlerpreiaiion as noi in (he best eduealional inieresis of 
minorily and disadviuitaged populaiiotis. 

Lei me lum quickly lo the second issue, thai is. ihe 
appropriaieness of the use of slandardi/ed and normative 
approaches lo lesling in ihe asscssmeni of ihe impact of laruc- 
seale educational programs. There are several interrelated 
problems here. Before discussirig them. 1 need to make cer- 
tain that the record shows thai I am coDsisienl. Since I have 
argued that these tests should nol be used in traditional ways 
with minority and disadvantaged populations, I must' also 
argue that they not be used to assess large-scale educational 
programs directed at these populations. In his academic lecture 
at- the 1973 Anierican Psychological Association annual 
meeting, Donald Hebb quoted one of his favorite admonitions. 
"If something is nol worth doing, it is also ntu worth doing 
welir To paraphrase, if these tests are not wonh using, 
they are also not worth using' on a large scale to make 
decisions about children's lives and to inform public [H)licy. 
But the problems of the evaluation of these programs are 
much bigger than the question of whether to test or not to 
test, or what tests to use. 

I estimate that we have invested since lv)63 between one- 
half and three-fourths of a billion dollars in evaluations of 
educational programs for the disadvantaged. There are 
currently two major studies underway f- a five-million- 
dollar NIE study and an Office of Education study that ! once 
heard estimated as possibly costing twenty-one million dollars 
over a seven-year periinJ. Those are' big sums of money even in 
periods of inflation. Yet, having examined the RFP for the OE 
study and having been rather close to the NIE study. I am 
not at all confident that either will provide the kind of guidance 
for the relevant policy decisions that is needed or expected. 
Like their predecessor studies, they are likely to produce 
equivocal findings. It is not because we don't have good and 
intelligent people designing and conducting these studies. 
When I went Jo Washington in 196,S lo provide leadership 
in the development of the research and evaluation program 
for Project Head Stan, a friend who is one of our most 
distinguished authorities in educational measurenient and re- 
search declined to assist me. He indicated that he would not 
touch such an evaluation as Head Stan or Title I with a fifty- 
foot pole because it was an impossible task in view of the 
absence of better agreement on what the tj^'atment is! the 
conditions under which it is delivered, and the absence of 
assessment instruments appropriate to the treatment, the 
conditions, and the populations served. Nonetheless, I went 
ahead and found good people to advi.se and to help, but 
no single one of us was, nor together were, good enough to 
overcome the constraining problems to which my friend called 
my attention as he sympathetically refused to join me in 
my folly. You know, it is my belief that if I were to ask 
him again today; he would still refuse because we have not 
adequately addressed the problems he rai.sed. Yet, we continue 
large-scale evaluations and continue to make the same .errors 
and continue to produce negative or confusing results. One 
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wonders if there is a conspiracy to prove that such programs 
cannot succeed, that minority and disadvantaged people cannot 
be educated, that it is poor policy to continue heavy invest- 
ments of public funds in efforts at cquali/ing educational 
opportunity. When one puts these evaluations together with the 
race and genetics debate and with the "schooling doesn't 
make a difference** pronouncements, it is exceedingly difficult 
to keep the faith. 

I know that this meeting was not called to discuss the 
problem of large-scale evaluation, but it is important for us 
to understand that the problem is larger than one of what 
kind of achievement tests to use. It may be that we could 
endure the [)roblems related to the tests if we were better able 
to deal with such problems as the following: 

1. the nebulousness and variability of treatments 

2. the complex economic, political, and scxcial context in 
which the treatments are set 

.V the diversity of populations served and goals sought 

4. the reconciliation of necessary and sufficient conditions 

for change and growth 
."S. such limitations of evaluative research technology as: 

a. program and population specification 

b. program and population sampling 

c. interchangeable and dialectical nature of the depend- 
ent and independent variables | 

d. inappropriateness of extant statistical analyses for 
the study of the dynamic blending of variables by j 
which effects may be explained j 

e. the policy of the best generic treatment 

f. normative approaches to aggregate data in search of 
relationships that may be idiosyncratically expressed. 

It may be that some of these problems will be the focus 
of our next conference. For the present, let us return to | 
achievement testing. What are the limitations of these tests for 1 
educational program evaluation? Suchman described five 1 
levels of evaluation research (Suchman. 1^)^)7). \ 

1. Evaluation should answer questions as to quantity and \ 
quality of treatment. Was treatment delivered.' how I 
much, and how giK)d? ' 

2. Evaluation should answer questions relative to per- 
formance or impact. Did any change occur that can be 
inferred to have resulted from the treatment? What are 
the intended as well as unintended consequences? 

}. Evaluation should address l,he question of adequacy. To 
what degree arc the results adequate to relieve the 
problem to which the treatment was applied? 

4. Evaluation should address questions of efficiency, is 
there a better way to achieve equivalent results? 
Evuluati()n should address tjuestit)ns of process and ex- 
planation. How and why did the treatment work or fail? 

Obviously, questions as to the nature and quantity of 
treatment or its efficiency cannot be addressed directly by 
achievement test data. However, questions of performance/ 
impact, of adequacy, and of process/explanation could and 
should be addressed by achievement data. The problem is 
that standardized norm-based tests contribute very little to 



these questions. In their present stale, these tests tell lis 
something about pcrtbnnanee in relation id stmie reterenee 
group. They enable us to make erude L:(>/no-L!i> deeisit)ns. 
They provide data that in the augreuate. inform us with re- 
spcet to positive* zero» or negative impaet. We may inter 
adequaey of treatment rrt)m the relative position ol the re- 
spondents* but since the tests tend not to be specilieall> re- 
lated to the criteria of eompctenee, ihey tell us little about the 
adequacy of the peilormanee or treatment in relation to need. 
Similarly* these tests are not directed at illuminating aspects 
of process. Altht)Ugh underlying processes can be inferred 
from the analysis of some the iien^s. assessment ol the 
process variables by which performance-treatment interactions 
can be judged is not the current purpose ot c;^.pabiliiy ol 
these tests. ^ In fact, the very processes by which we deveU)p 
them arc eounter|)roductive as far as data that speak to 
questions of adequacy, process, and explanation are con 
cemed. As we strive to achieve reliability and validity, we 
are forced to eliminate items sensitive to situational and 
personalisiic variance, or tnhenvise unstable. What we Uu)k 
for are items that arc least influenced by variatit)ns in in- 
struction or in pupils. In sum. I am asserting that if good 
evaluation data are neeiled to inform policy decision-making, 
then good evaluation procedures and instrumentatit)n must 
be applied, Since the achievement tests available to us fail 
to address crucial evaluation questions, they are inadequate 
to the task at hand. In '.)nimenting on a related point. Callec 
(1976) wrote: **lf a principal, superintendent or program 
director (or legislator) is to make infonned. ratii)nal decisions 
about the strengths and weaknesses t)f the teaching and 
learning thai lake place under his supervision, something 
more than a gross characterization of success or failure is 
necessary/* I think I cannot be accused of overstating the 
case when I claim that traditional approaches to norm-based 
standardized testing fail to provide more than gross char- 
acterizations of success and failure. This is true of their use 
with all children. When we use them to assess achievement 
in and programs for the poor, the disadvantaged, and the 
discriminated against, the problem is compounded. 

Given this low estimate of the utility of noniiative and 
standardized approaches to achievement testing and the 
equally low likelihcxxi that the call for a moratorium will 
be heeded, j what can be done to improve api)n ihi: current 
state of the arts? 

Despite my criticisms of the extant standardized instru- 
ments, they need not be immediately discarded. A great deal of 
work has gone into the development of item pools that tap 
a variety of intellective functions. The problem is that these 
items have been grouped, presented, scored, and analyzed 
with a view toward gross classification with respect to success 
or failure, with a view toward distributing the examinee 
population over the bell-shaped curve, and with a view to- 
ward predicting who will succeed. These same instruments 
can. however, be analyzed for the following purposes: 
,1. To identify the dimensional or categorical functional 
demandsl of selected standardized tests. What dimen- 
sions of function appear to be tapped by the instrument 
as these ;can be conceptualized from a surface examina- 
tion of item content? 
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2. To determine the rationale uitili/ed in the develop- 
menl of each of several tests u\ order to identify the 
conceptual categt)ries for which itei^js were written and 
into which item-response consistenVjes might cluster 
ciiipirically . 

.V To determine the learning-task demands represented by 
the items oi selected tests and the classification of those 
demai\ds into functional categories. The extent a^which 
selected tests provide adequate coverage o{ the typical 
learning-task demands found in educational settings 
might also he appraised. Are the tests measuring the 
processes required by impiirtant learning tasks? What 
t\pes o( learning-task demands corres|)ond to the pro- 
cesses ostensibly measured by the test? 

4. To utilize the categories produced by any or all of the 
abt)ve strategics in the metric and nonmetric factorial 
analysis oi test data in order to uncover empirical dimen- 
sions of test a*sp()nses. These dimensions could be 
interpreted in the context of item clusters derived from 
the conceptual and task analytic tratcgics described 
above to ascertain the context to which they provide 
an empirical foundation for those clusters or require a 
rcc()nceptualization of response processes. The empirical 
dimensions could then be used to produce individual 
and group profiles rctlccting across the several cate- 
gories or factors. 

Numbers 1 . 2. and 3 above arc intended to unbundle 
existing standardized tests and to reveal their factorial demand 
slnicturc. They arc basic to number 4. which involves the 
analysis of perfoniiance data to reveal diagnostic patterns that 
, become the basis for the profiles suggested in number four.. 

In addition, with these same instruments we could do the 
folIt)wing: 

1. Explore possibilities ur adding to their quantitative 
reports on the performance of students, reports descrip- 

■ live of the patterns of achievetnent and function derived 
\ from the qualitative analysis of existing tests. Existing 
\ instruments should be examined with a view lo catego- 
rization, factorial analysis, and interpretation to de- 
\ termine whether the diia of these instalments can be 
\ reported in descriptive and qualitative ways, in addition 
\ to the traditional quantitative report. For example, re- 
\ response patterns might be prepared differentially for: 

a. .Infoniiation recall 
^ (1) Rote recall 

(2) Associative recall 
\ {}) Derivative recall 

! b. Vocabulary 
i ( I ) Absolute 

(2) Contextual 

2. M'|)ve away from existing instruments and explore the 
development of test items and procedures that lend 
thcfnselves to descriptive and qualitative analyses of 
co^itive and affective adaptive functions, in addition 
to vVider specific achievements. 



a. In the dcvclopincnl ot new losis. allcMtion shouUl ho 
given lo the appraisal ol 

(1) Adaptation in new learning situations 

(2) Problem solving in situations that require vaneil 
cognitive skills arid styles 

(3) Analysis, search, and synthesis beha\iors 

(4) Infonnalion management, processing, and uiili- 
zation skills 

(5) Nonstandard infonnalion pools 

b. In the development of new procedures, altcniion 
should be given lo the ap{)raisal ol 

( 1 ) Comprehension through experiences, listening, 
and looking, as well as reading 

(2) Expression through artistic, oral, nonverbal. ;muI 
graphic, as well as written symbol i/ation 

(.1) Characteristics of temperament 

(4) Sources and status of motivation 

(5) Habits of work and task involvement under varv 
ing ci)ndilions of demand 

- c. In the development of tests and procedures designed lo 
get at specific achievements, attention should be given 
..to 

( [) Broadening the varieties of subject matter, eom- 
pclcncies. and the skills assessed 

(2) Examining the achievements in a variety of con- 
texts 

(3) Open-ended and unstructured probes of achieve- 
ment to allow for atypical patterns and varieties 
of achievement 

\ - (4) Assessing nonacademic achievements such as 

\ social competence, coping skills, avocational 

\ skills, and anislic. athletic, political, or rncch- 

anical skills 

Cl'aifce and others have been experimenting with some 
allemative approaches to prediction based on **all-or-none 
tests." They as.sert that there are some indicator skills the 
mastery of which is essential to next steps in learning. Know- 
fcdge of the alphabet is an example of such a skill.. It is known 
to De predictive of subsequent performance on reading 
achievement tests. Calfee assens that ''alphabet knowledge 
is an indicator, not a cause, of reading success and failure.** 
On the basis of empiiical data, one can detenninc "cut-off 
points'' by which we can predict success or failure in read- 
ing mastery. It is basically a criterion-referenced test pro- 
cedure in which the criteiion is based upon specific skills or 
competencies known to be indicative of readiness for the next 
level of work. The procedure can bo used as a diagnostic 
screening device, as a tool of pupil evaluation, as an instru- 
ment of program evaluation, or in needs assessment, It does 
not identify process, but is an indicator of success or failure 
in a crucial element in process. 

Another alternative is represented \v/ Project TORQUE, 
which claims to develop tests that help teachers help stu- 
dents. TORQUE can also be used to evaluate large groups 
of students or lo assess the impact of particular curriculum 
materials. The developers of the test claim that their instru- 
ment is diagnosfic, that it identifies what children know 
and do well, as well as pinpointing children's problems 



closeU enough lo help guide lurther uisiruclion I hey claim 
scnsitiviiN lo children's varicil characierisiics. .All ol this 
is made available through a criienon-referenced model easily 
administered by teachers. 

Obviously, criterion-referenced testing is one of the 
altcnKilives available to us. Since there is a session scheduled 
on this subject. I will not iliscuss the appniacli further ex- 
cept for a cautionary note. 

Tradition weigiis heavily on all of us. We lend to try 
lo legitimatize the new by reference to the old. In a number 
of instances, we try to demonstrate the goodness or validity 
of a criterion-referenced lest by showing that it correlates 
well with an achievement or intelligence test. That may be 
necessary lo gain respectability or acceptance, but it can 
defeat the purpose behind our movement away Ironi norm- 
based standardized testing. Eor example, when we were 
selecting instruments with which to assess tlie impact of the 
early Head Start efforts, we asked Hettye Caldwell lo develop 
an idea she had for a criterion -re fere need test of mastery of 
Ihosc- developmental and prelitcracy skills judged to be 
associated with successful school entry. The Caldwell Pre- 
school Inventory was the result. However, in an effort to 
gain credibility for the Inventory and later for the impact data 
izenerated therefroin. we added standardized tests of intel- 
ligence and achieveinent to the battery. As the p/'cssure 
to demonstrate Head Start's effectiveness mounted, the 
criterion-re fereneed test was dropped and the standardized lest 
remained, even though it was the Caldwell Inventory that best 
addressed the growth in skills that was the goal of the special 
program. Else Haeusscnnann went into retirement regretting 
that her excellent prcKcdurcs for assessing learning processes 
in cliildrc!! with cerebral damage had not been standardized 
and age-group nomis established. So heavily did tradition 
weigh on her conception of what she was doing that she 
never was convinced that her crilerion-referenced techniques 
derived a great part oV their value from the fact that they 
were not c^mstrained by standardization and the interpreta- 
tion of the data was not limited by norm-based scoring. 

One final example. In a highly diagnostic inode. Glaser 
described a perforniance analytic approach lo the assess- 
ment of memory function. Drawing upon a conceptualiza- 
tion of the processes involved in short-lenn memor> for 
sequences of items, he suggested that analyses of pertbrmance 
based upon such conceptualizations may have implications 
for assessing individual differences as, well as for improving 
perforinance. Glaser wrote. 

A young or mentally retarded child might fail the 
test because of insufficient familiarity with the se- 
quence of ordinal numbers, or because of inxeperience 
in using the number sequence to order other materials. 
An individual may not perform well because he has not 
' developed the grouping and chunking strategy char- 
acteristic of his age level, although he might utilize 
izrouping when prompted by the examiner. Another 
individual may not be able to accomplish the coding 
pn)cess necessary to take advantage of chunking. Others 
rnight lack the capacity for holding back their working 
memory storage long enough to order their output 



properly. With ihc a(l\aiUiiL'c ot ihis kiiul i>t added 
ihcorcliciil iiisielit lo aui^ukMil ihc ciMiXL'iiiii>nal inlcl 
licence lest dii!il span suh icsi. ii iniL'hl k* possible lo 
localize the source of dirtieully tor an indivulual who 
fails under the siantlard procedure This could he ol 
considerable lielp in mdicaliny how delicicnl per 
forniance in this and relaled tasks niii^hi he iviiu-died. 
Studies like ihose jusi descnhed r.iisV the pt>s' 
' sif^ility that measures of intclhijeiKC and apiiludc. 
analv/.ed in terms of coiiniiivc processes, will nunc 
intelligence and aptitude test prLMliclions from sialic 
statements abou'. the probal^ilits ol success lo d\naniic 
"statements about wh;li can be done lo increase ihc 
likelihood of school success. Uopclull), tliis vu-w 
point will lead to liieasurinu iMsirumctils whuh arc 
diaiinostie, in the sense thai ihey lell us how cduca 
tional institutions shiuild adjusl lo ihe person, instead ol 
simply tellinti us, as mosi iniclliuencc icsis do. which 
people alread) are atijusicd u> iIil- insiiiuiion 

Bducational assessment of individuals and programs 
izreatly influences what happens in ihc delivery of educa- 
tional services. Whether we like il or noi, whether we iniend 
it or not. what teachers teach and the way they teach arc 
in large measure determined by the characteristics tif the 
a.ssessment instruments and programs. In addititWi, the results 
of what we do in evaluation no longer remain hidden aw:i\ • 
in dusty tiles. Our findings are more and nmre frequently 
used to support the biases and purposes of public policy 
makers. Thus, what we measure and the wa> we measure it 
impinge heavily on the lives of indi\ iduals and on the society 
in general. These observations seem to suggest that ihe prob- 
lems we face are not onl> technical, but also involve 
philosophical anti moral issues: 

What is it that we w arn eilucalion to be .' 
What are the behaviors and goals of educators and 
learners that we are willing to encourage? 
What priorities in public policv are we willing to sup- 
port? 

What is the coniribution oi our work tt> the achieve- 
ment of social justice/ 

REFERENCES 

Calfce. Robcn. "Pracitcal INcs ot .Xssessnieni Un Irulividdaliml 
Reading Instruction." Unpublished proceedings ot' the Cou 
ference on Beginning Reading liisiruLin)n I'niversity o\' 
Pittsburgh. LRDC. May. 

(jiaser. Roben. *'C)n IntelligetiL-e and .Apiiiudes * I'npuhlished 
paper read at ihc Work Oniterenee on J-Aphiring Aliernaiivcs 
lo Current Siandar(|i/ed Tests. I'niversily ol IMllshurgh. 
May. r976. 

Maeussemiann. Hlsc. ne\r(<fpfm'ntiil poivwinl ttf pn'schtuil i hilitn-n. 

New York: Grune and .Siration. I^).>>< 
Hayden, Robert C. Profed Torque: a new upprinu h 'lu flu- </.vvr>N- 

men! of children's matliemmunl compi'tcnuv N'cwiori. Mass: 

F^ilucational I>:vcloprneni Center. P)7^ 



}K'hl\ DoiKtId " Whal Psveholot'v is \houl ' \"/. //<</// i*\\iho 

/('i,'/Nr fehruaiA . I 
Sui-liinail. l-.dwiird \ i.wilunttM- icsntfili f>f im if>h \ ifn,l /XiU lur 

in f>ul>(ii N('/\/<<' .;/;</ Mh uil xution f*r<n;r,ifn\ New Vork. 

Kussell S.iiie. \')(^'^ 
Williams. Koberi I. " Ihe lUTCll lon; X Culluie S|Viitie lesi.'" 

Hii .hmnutl <'( \lfi> Atfirriiiin h\H( \ V No I (WinUM h»?s) 



ANNOUNCING 
THE lUME 
REPORT SERIES 



Ihe Insiitute for Urban and Minority Llducation 
is pleased to announce the first five lilies ot 
ihe lUMH Report Series which are available for 
SI .00 each from 

lUMK 
Box 40 

Feachcrs College, Columbia CnivtTsity 
New York, Now York 10027 

No. I New York City Spanish: Myths. Structure 
and Slates. William CJ. Milan. 

No. 2 Psychological Anthropology and Lduca- 
lional J['ractice. Charles C. Harrington. 

No. 3 Project Talent: An Empirical Study to Aid. 
in F-ormulating Rducy tional Goals - Re- 
llections on the Changing Role and Sources 
oi Guidance in the Process of Student 
Development. Edmund W. Gordon. Wh. 

No. 4 Textbooks and Political Socialization: A 
Multivariate Analysis. Charles C. Harring- 
ton. \')7h. 

So. 5 The Nonimplemeniali()nof FihP:*'AII That 
VUiney for Business as Usual." Constancia 
' Warren. 1076. 
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INSTITUTES 



The Second Annual Regional Conference on 
BILINGUAL' EDUCATION 

sponsored by **Bilint!uar' General AssisUuieo Center and 
the Institute for Urhan and Minority Hdueation 

SATURDAY, JUNE 4, 1977 

^^a,ni, to 4:30 p.m. at leaehers College. Colunihia University 
52^ West I2()th Street. New York. New York 



Speakers include: 



Pasquila Ayahi 
Lawrence A. Crciuiii 
Hdnuind VV. Ciordoii 
Charles Harrington 
Maria Anionia Iri/aiT\ 
Harold J. Noah 
A. Harry Passow 
Carmen RodrlLiue/ 

and the staff of the 

''Bilinguar* (ieneral Assistance Center 
at Teachers College 



For information call or write: 

Ms. Ada An^zlada 

''BiliniZuaL' General Assistance Center 
Teachers Collciie. C\)lunibla Univer>iiy 
New York. New York 10027 
(212)678-3155 



Departtiient of Special Education. Teachers College. Colutnbia University 

A SUMMER TRAINI^Ii5^^^^STITUTE on 

The Learning Potential Assessment Device (LPAD) and 

Instrumental Enrichment (IE) 

conducted by Dr. Reuven Feuerstein 

and his staff of the Hadassah-WIZO-Canada Research Institute. Jerusalem. Israel 
at Teachers College, Columbia University 
525 West. 120th Street. New Vork. New York 

August M2, 1977 

Dr. Feuerstein and his staff will devote the first week to For additional information, contact: 
elaborating on the theoretical framework of LPAD and train- 
ing institute participants to administer this test effectively to 
adolescents with serious learning problems. The second week 
will be devoted to training clinicians and teachers in the use of 
IE as a psycho-educational tool for enhancing cognitive skills 
particularly among adolescents who are failing at sehiK)l. 
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Professor Abraham Tannenhaum 
Department of Special lulucation 
Box 223 

Teachers College. Columbia University 
New York. New York 10027 



CONFERENCE 



INSTITUTE ON 
BILINGUAL EDUCATION 

at Teachers College, Columbia University 
New York. New York 10027 

June 6-30, 1977 



Sociolinguistic Foundations of Hilin^uai Kducation 

Four-week course. June 6-30. 1977 
Prof. Joshua A. Fishman (Ycshiva University) 
''Language Planning" as an approach lo language ciMiccrns. 
particularly bilingual education. Study of the social contexts 
of bilingual education through an explanation of typologies, 
.societal parameters, local studies and demographies. Class 
room dynamics and other priKes.scs. of bilingual education 
in social perspective, including academic and non-academic 
outcomes of bilingual education: comparisons between cross- 
cultural profiles. 

Comparative Bilingual Education: Wales, USSR, LSA 

Four- week course. June 6-30. 1977 

Prof. E. Glyn Lewis (University of Swansea. Wak^s) 
Historical and contemporary aspects ot bilingual education 
including the study of expanding educational opportunity. 
Review of theory and models as well as comparisons of 
examples in several countries: Britain. Belgium. Soviet Union. 
Canada. U.S. Largely sociological approach with .some cinn- 
parative studies of the psychological and linguistic aspects 
of bilingual education. 

Methods and Materials of Bilingual Education 

Two- week course. June 20-30. 1977 
Mrs, Maria M. Swanson (Bilingual Education Service 
Center) 

Linguistic and cultural considerations in bilingual edut:ati()n. 
including instructional techniques in content areas. language 
development and selection and adaptation of material. An ex- 
amination of classroom management and its application to 
specific school setting.s and student populations; development 
of curriculum units and ins-nictional learning packets. 



Psycholin^uistic Foundations of Bilingual Education, 
Part I: Cognitive Processes 

Two-week course, June 6-17, 1977' 
Prof. Wallace E, Lambert (Mc Gill University) 
Psychological factors that underiie bilingual education iti 
Nonh America, paniculariy tho.se relevant to motivation, per- 
ception and their roles in second- language learning or tirsi 
language maintenance; the importance of identity feelings in 
multicultural society; and the impact of various fonus of bi- 
lingualism on intellectual and cognitive development. Op- 
portunities to develop educational and psychological research 
skills, 

P.sycholinguistic Foundations of Bilingual Education, 
Part II: Academic Outcomes 

Two- week course, June 20-30, 1977 
Prof. Frederick Genesee (Mc Gill University) 
The process of bilingual education with special emphasis on 
pedagogical issues; a,ssessmeni of effectiveness of bilingual 
education; individual student differences in successful bi- 
lingual education; acquisition of language skills; and the role 
of the teacher in bilingual education. 

Colloquium on Bilingual Education 

Four-week course, June 6-30, 1977 
All Faculty 

(Guided Research in Bilingual Education 

Four-week course, June 6-30, 1977 
All Faculty 



For further Information, contact: Mrs Fllic M Bynuni 

Box 75, Teachers College. Columbia Universnv. Scv, York, New York 10027 
(212) f)7X-37S() 
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A Critical Rt-view of «/ac* Consciousness, Identity (U 

(1968) and other conlciiiporaO' scholars have JLMiionslralal 
how inadequately the nialril'ocal slereotvfx; descrihes the 
diversity of black families in America, so (Jurin and lipps 
unmask the stereotyping of black siudcnls. more specifically 
the stu^lents in black southern colleiies who were the ohiecl 
of their research. 

The students varied in the Iradilionaiily and the presliiic 
and difficulty levels of their occupational aspirations. They 
had vjiried perceptions of the opportunities open to ihei'n in 
different wprk sectors and iieoi^raphic regions. Thcy varied 
in their sense of personal control in their lives ami in their 
beliefs about control in socielv generally, in their expecta- 
tions of academic success, and in their needs for achieve- 
ment, .success, and security. They varied further in their 
concern with racial identity, their concern with integration, 
their analyses of racial inequities, and their social change 
Strategies. They were male and female. They came from both 
rural and urban settings, and from families of different social 
structures and income levels. The import of a number of 
these variations turned out to be quite different from what 
one would have predicted from prevailing stereotypes. 

The colleges in which Gurm and Epps did their research 
were a purposive sample of hislbrically black colleges, vary- 
ing in their being public or private institutions, in their 
academic prestige, and in the size of their sludtnt bodies. 
The colleges were found to vary as well in their students* 
backgrounds and entering orientations, the diversity of stu- 
dent activities, the amount of student-faculty interaction, and 
their student culturesf'the students' criticism of traditional 
academic governance, the students' activism, the students* 
breadth of extracurricular involvement, their extracurricular 
leadership, their support of fraternities and ::tirorities. and the 
academic stress in the student culture. 

The Plan of the Book 

How does one penetrate this mass of variables? The 
plan of the book is straightforward. It a.sks fust what faettirs 
influenced the students' individual achievement: their ;ica- 
demic and occupational aspirations, academic perfonuanee. 
and achievement motivation. Next it investigates what the 
authors call collective achievement: grc^up action and col- 
lective commitments. Last, the relationship between indi- 
vidual and collective achievement is examined: the ways in 
which different students focused more on one or the other 
concern or, in the phrase Gurin and Epps use. "put it all 
together." 

The statistical strategy of the research has strengths and 
limitations. The following quotation omits the authors' 
technical discussion, but conveys the idea of the analysis 
they use to greatest effect; 

In' many analyses in this boo^-. we are imerested in . 
examining the effects of a number of variables on a 
given dependent variable, such as occupational as- 
pirations. One technique particularly well suited to our 
purpose is the Multiple Classification Analysis. .. To 
illustrate what we accomplish using this technique. 
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f Achievement . < tmtnuu'd inun fui^^i- i 

consider the effect ol lather absence oi» whether the 
father exercised intlircncc over the decision to 

uo to college. As expected, fathers who did not live 
m the home were re[)orteti hy their chiUircn as less 
inlluennal on the college decisiorv Since we know that 
fallicr-absent families also have lower lamily incomes 
and. furtherntore. that the father's intlucnce in the 
college decision is affected by total family income, we 
want to know whether father absence is important after 
adjusting for the effects of family income. The MCA 
prov-ides fin estimate of the lather absence effect hy 
indicating what its effect would be // family income 
among father-absent families were exactly the same as 
it is for the total sample, (p. 117) 

A limitation of these analyses that the authors them- 
selves discuss is the difficulty of drawing causal inferences 
from correlations when the variables being correlated were 
measured simultaneously. Tlje three ?iuhstudies in which 
they followed 19M-196.S freshmen in one college over the 
course of four years escape this limitation most effectively. 
In the larger 19f>4 study, the fact that grades reflected 
academic achievement at the end of a collegt^ year, while 
the questionnnaire tapping demographic and orientation vari- 
ables was administered at registration, gives some temporal 
perspe(^tive to the relationships between achievement and these 
other variables. Again, aspirations and motivafion were 
measured at both the beginning and the end of the academic 
year for the freshmen in all ten colleges in the study. 
Other analyses are somewhat weaker in this regard. , - , 

Gurin and Epps regularly' refer to the findings of other 
research, though not always to agree with previous con- 
clusions. Overall, the argument is both careful and bold. 
Virtually every sentence contains new infonnatiun or new 
reasoning jjflnd on these grounds alone the book is ditficuli 
to read. One can only sumiiiiiri/e its f indings by leaving be- 
hind mosi of the a)ntext that gives them .their crt^nlibifiiy . 

Individual Achievement 

Between .80 and 90 percent of the stude^its in the 
and 1970 studies aspired to enter a profession, and sinnlar 
proportions wanted to continue their education in graduate 
or professional schiH)l. These proporticuis were higher than 
the national averages in 19M. a year (or which comparable 
national stati.stics are available. However, only between S 
and 20 percent of the students were certain thcy would be 
able to continue beyond the baccalaureate. This correlates 
strongly with their families* income levels. Proportionally tlve 
times as many students in this sample — and indeed in black 
colleges generally as white students in white colleges 
during a comparable year came from families whose incomes 
-were below the poverty line. Seventy percent of the students 
worked while in college, and more than fifty percent borrowed 
money. Gurin and Epps juxtapose these findings with the 
fact, established in other research, that the students in 
historically black colleges place above the national average 
in completing their bachelor's degrees. The students* per- 



SISICIK-C aiul Ihc CollOL'i's" ti'll.iiltV A\C llMIUli'sl III lIlfSL* il.ll.l 

as is ihc iiccJ tor iiktlMsciI (hhiu i.iI suppoil ut hLn k siuili'tils" 
[)i)slbaccalaurcaic siiidics 

As iIk' job a i:i\CM stiulnit aspuvtl to uas iiilinl In ilu' 
sluJcnrs ptxTs. sliulcnt t»L'Lii|Kiiii>iial as^iralioiis. n\iMall. 
were hiuhcT ifi icniis i)t" pivslii^c, alMlil\ iltMnaiuls. .iiul sni i.il 
JifficuIlN CMhc rclalivi^ cliaiu'cs a l)lack .iiu! a \^\\\W applicaiii. 
cquallN irainctl. would ha\c uctlini^ tlu' )oh iii llic same ciu 
in the same sector o\ ihe einmliA" }v 47) l*lu'\ s^eie aUn 
hiuh in noniradilii)nalli> . the basis i^t .i coiiipjiisvMi uitli 
the pereeniaiic ot blaeks ulio were |oblu)lilers in a L:i\eii 
ealenory in (he smdenis \aiieil c»>iisuleial)l> . none 

ihcless, in llie abibty deni.uids and social dittkult> ot :lie |obs 
ifiey asf)ired lo. and siirtieienli> in ihe presiiL^e and luui 
tiadilionalilv ot the jobs lo raise que lions .ilniiii ihe tactins 
lhal niiulil aeeouni tor ihese \ ariaiions 

Sex role strongly inlluenced llie sliulents' Ljradiiau' Miul\ 
and oeeupational a.spiralu>ns, "C\)ntrary lo siLMVoiyped noiioiis 
about ihe doniinanee ot Blaek uoinen. the pkliire oi 
aspiration 111 ihe men siudenls nuieh belter than llie ssvMiien 
The eoals of women stiidenls relleeled lower levels on al 
nuvst every measure ot as pi ra lion tp. 4S)." 

The dilTerenees between the men's and the women's 
aspirations — tor e\am[)le. that three times as many men 
as women planned to pursue doctorate i>r prolessional 
deiirees -- very closely corresponded to ihe dit'lerences thai 
other studies have show n to t)biain tor men and women college 
students nationally. The men and women rliied job presiiue 
and dit'tlculty levels identically, but they ditTered ureatly 
in their opinions ot' which jobs' w ould be llie most personallv 
desirable. Hie presiitie and diftlcuily levels of the jobs ihe 
women aspired to were substantially lower than those of the 
inen. kcadint: Gurin and Hpps-'s discussion of these findiuLis. 
one i?^ appalled both that the pattern of the encom[)assinL' 
culture applies so stroniily for blacks, and that -the niatri- 
focal steret)ty[)e inlerleres so slrontiiy with the recoiznition ot 
this. 

, Followinii these tirM findings there appears in ihe tnx^k 
an analysis ot' *'the motivational dynamics of aspiratiiMi and 
performance" that is treated as a cornerstone of the argu- 
ment as a whole. Rotter's Internal-I-Alernal C\)nlrol Scale is 
shown to contain two types of itenis rather than the one type 
originally supp)sed. at least as black students respond lo 
these' items, and possibly as more socially conscious while 
students would rcsp<ind to them. One set of items the authors 
<all ''sense of personal control/* the others they call "control 
ideology." Students who consistently chose the internal state- 
ment on the personarcontrol items **.showed a strong con- 
viction thai they could control what happened in their lives/* 
Choosing the internal statement' on the control ideoli>gy 
items ''meant rejecting the belief thai success follows from 
luck, the right breaks, or knowing ti;e right people in favor 
of the traditional Protest::nt ethic explanation of success** 
(p. 71). 

From previous research the, authors inter that bhick 
students in America on the average have ^bscribed lo an 
internal Qonirol uleolo\>y as much as white students have, 
but that they have felt less personal control over their lives. 
In the present study the aujhors probe the consequences of 
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llu'sc ilitterenl i on\ u•Il(»ll^'* SiiuK-iiIs' inlern.il simisc 
/N7sr»//(// loniiol w.is posili\L'l\ u'laU'il loi hoili iMiMi aiul 
women lo cimnihitiV': uiadc^. plc^ll.L:c o\ t»i cu}^.1I•"n.ll .i-pna 
Mom. jhilil\ di'inaiuls (»t ore iip.ilioiKil aspinlion. ainl "iraduale . 
oi prolossional schin^l aspiialioii Ihcie sm'ic sevcul oihei 
siiih iclalHMishi[)s tor men (M women onl\ liilcnial conuoi 
/,Av/(»C\. nn llic i>llici Iiand. hou» iu> ' pv^miIn e ivkNiionship 
lo .in\ mcasiiie ot ;iiadcmic achievenuMil o\ ocoiip.itioiMl ami 
academic aspiration I'or stiuleiils w nh ,i sense o\ (visonal 
contioi. conlro! ideoloi:> was simpK nieKnaiil lo these 
iiieasiircs \ o\ siudenls \Mlh a low sense o\ personal eontroL 
luu\e\er. internal coiilrol uleoloi!\ leiaU'd nciijli\el> \o 
several ot ihc measinvs. In v>llici \wMiK^. lack ol tontidence 
in personal abilil\ to ciMilrol one's own lite iomhinni with 
a siiong belict. m ihe IMoieslaiil eili'e. was pariiciilarU 
dehililating lo aeadcimc acliie\emeiit and oevupational and 
aeadcmic asfMration. 

Did the sirueiurcs ot ihe simlenls' tainities. iheir rural or 
iheir urban settings, or the tainilies' income levels attecl 
ihe iniernalilN i)t their personal conlri)l or eonliol ide(^loe\ 
liie\plical)l\ , and creating nuieh Irustration for ihe reader.- 
it is difficult to- find wiierc (iurin and l-pps address this 
question. They nowhere use the sjvcitie phrases • personal 
conirol * and "Ci)nlrol ideology " m ihe chapter on [)recoIle^e 
background that nnmediaiely lollows the moli valional dy „ 
namies chapter. One tinally infers tiiHii a table on "work 
ethic* values" in the .Appendix to.r this chapter, and from 
siinijar table on 'control ideology" for a huer chapter, that 
the ideology variable nas been renamed and that it related 
lo none of the deniographic variables except, tor men, ihe 
rural t)r urban setting of the place the student VwC-d tor most 
ot his life. Wui coni])arable datj is nowhere available for in- 
ternal control. 

ihe surrounding pieces of the puzzle are presented, 
and they are striking indeed. C}urin and I-pps summarize their 
tindings as lollows: 

1, Social background simply did not intluence college [vr- 
formance or pertormance on typical achie\emenl im^- 
tivation tasks. 

2. At the freshman level men from very poor families and 
t*rt)iii families with low educational attainments held 
lower job aspirations than any other group of men. Wom- 
en tVom such families also held lower aspirations, 
espeeially as compared to freshman women from families 
with moderate inc(MTjes and some college education in 
the previous generati(^n. 

V Social background was not significantly related to either 
achievement motives or values 

4. The opportunity aspects ot the, students' precollege en- 
vironments, especially the level of iheir family incomes 
and rural setting of their homes, did • intluo*fce ex- 
pectancies of success. Although students from such 
backgrounds altaeheiJ the same imponance as other stu- 
dents to getting an advanced degree, they were con- 
siderably less certain that they would be able to realize 
that g(Kd. Similarly, students from rural areas and low 
income families assessed their chances of actually getting 



ihe^jobs they desire at a much lower level of probability 
despite feeling equally selt-contldeni about their abili- 
* ties ic pertonn at iho^e jobs (p. 123). 

The 'achievement nicMives and values** referred lo in 
this summ.'.iry might appoMr to include Ihe personal control 
variable, but this is not clear either in the text oi in the ap- 
pendices. Achievement motivation data obtained from .several 
other in iniments are reported along with Ithe work ethic data 
and the findings from a general life values measure. One 
w^nts to see precist'ly how personal control tits into the total 
picture. -That it is not influeneed by family structure is 
consistent with the general argument, which would be 
strengthened by evidenee on the question. But thai it should 
not be affected by family income is less apparent. At what 
points in the interface between blacks and the Ameriean 
system do we account for black students* having, overall, 
less sense of p<.*>onal control over their lives? Gurin and 
Upps themselves make the following summary statement 
later in the book 

We saw no evidence that achievement-related values — 
those pertaining to ambition, hard work, success, 
materialism, or immediate and^ long-term gratifica- 
tion — reflected the students' social backgrounds. 
But social background did influence expectations 
of success, which further influenced aspirations. More- 
over, the aspects of the background that especially 
influenced expectancies and aspirations were closely 
tied lo opponunity and resources. Family income and 
rural-urban residence were far more influential than 
either parental education or family structure, (p. IS,"^) 

Even without the missing piece on personal control, 
this is a very powerful set of findings, ^fxhough two weighty, 
pans of the b<K^k remain, this already established it as a land- 
mark study. 

fr such a complicated study, deci^ons about what to 
present to the reader must have been extraordinarily diffi- 
cult, as was. the authors observe themselves, the original 
collection of '.he data. One admires both the breadth of the 
research and its precision in countless details. The authors 
-recognize that the students in their sample are. by the very 
fact of their being in college, not necessarily representative 
of black youth in general. From an opposite standpoint, 
however, the students can be said not to have been immune 
to the motivational dynamics that Gurin and Epps hypo- 
thesized. A longitudinal substudy in one of the colleges com- 
pared dropouts with students who completed their degrees 
and suggested further subtleties of these dynamics that have 
counseling implications. The follow-up questionnaire ad- 
ministered to all of the freshmen in the ten colleges at the 
end of the 1964-1965 school year revealed effects of the col- 
lege environments on the students* motivation and aspira- 
tions: 

Generally, we have found that the 10 colleges showed 
different levels of student aspiration and motiva- 
tion either because they selected students who already 
differed when they entered college, because certain 
colleges were able to buffer their students against the 



izeneral tendency of lowering aspirativ^ns ■ during the 
freshman year while other colleges were not, or be- 
cause; the college experience actually accentuated the 
initial differences the entering freshmen brought lo these 
id/olleges. (p. 169-170) 

In three colleges, Gurin and Epps discoverv^d patterns that 
went beyond., and in some respects presenled exceptions lo, 
these general trends. In one, a small private college of high 
academic repute that traditionally sent many students on lo 
graduate school, the students not only entered with high 
occupational and academic aspirations, but also completed 
the freshman year with a.spirations that were still higher. 
The student culiure in this college was found to be relatively 
nonactivisi and to stress academic values the most strongly 
of all the colleges. More than this, the faculty was ob.scrved. 
by students and researchers alike, lo be extraordinarily 
concerned with the individual growth of virtually every stu- 
dent. Some students;^ particularly those of more. urban origin, 
resented the one-big-happy-family approach of this faculty. 
Many more appreciated it. however, /and Gurin and Epps link 
its success in promoting achievement to a more communal, 
rather than compciiiive, approach lo students' development. 
A second college at bcsl maintained, and in some respects 
depressed, originally high . motivation and aspirations. This 
was an elite black college with a reputation for political 
activism, but in which students' actual participation in protest 
or izovemance actions, or indeed in extracurricular activities 
generally, was found to be quite low. The college was also 
known for its graduates' unusual achievements, but the 
students seemed lo feel thai their simply being in the col- 
lege guaranteed them this achievement. Overall, t^"- stance of 
the students in this college retlected disengagement. Finally, 
in a third college, students' motivation and aspiralions were 
redirected, from somewhat low to higher job and posteollege 
educational aspirations, and from security concenis to a greaier 
concern about. success and status. These shifts took place at the 
same time ihat the students' academic perfoniiance was 
considerably lower than would have been predicted from their 
SAT's on entering college. They seemed to be more bent 
on "doing something unusual that is recognized as signifi- 
cant," and were supported in this by an environment where 
''the new. the different, and the unconventional were enter- 
tained amidst the much more prevailing traditional influences 
in the state." Gurin and Epps imply that these new interests 
merged individual with collective achievement. Following 
this third case study, the authors make their transition to the 
second part of the btxik, which focuses on group action and 
collective commitments. 

Collective Achievement 

It was in February. I960 that black- students sat in at a 
lunch counter in Greensboro. North Carolina, sparking a 
civil rights movement that spread throughciut the Old South. 
By the summer of 1964. substantial victories, culminating in 
the Civil Rights Act. and setbacks, notably ihe I9(>1 Demo- 
cratic National Convention compromise over the Mississippi 
Freedom Democratic Party's challenge to traditional while 
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conir(>i, had ocLurcd. SiudLMUs' oltLiinipiis aclivisiM peaked 
during ihc Selma and Monii2i>nK'r\ marches o\ Thca*- 
at'lLT, studcnls continued lo he concerned uiih civil riiihls. 
hul ihey focused incrcasiiiL! alien! ion on ihe i!o\ernancc c.i 
co!let!<". prouranis and campus lite. (Jurin and l*"pps discu^s 
these evenis as ihe hisiorical-polilical conicM \n vvhich ihen 
I9M and I^>7() studies were set 

Most of the l^^M stiulcnis indivaied their coniinitnient 
to intciiratioi*., racial priile, and hotli socioeconomic (svstem- 
bhuMiiii!) and individualistic ( selt-hlamini: ) evplanalions ot 
racial inctjuities. Vcw shov.eil an> evidence of the nei!ati\L' 
identificatuni so often attributed to blacks, but few preferred 
ci^IIeclivc to individual action as a social chani:e stralcil) 
Between 19^4 and 1970 there were distinct chani!cs in the 
student's convictions. The students bccaine morec\ nical about 
the likelihood of integration. They shifted stronuly awa\ 
fnSiu itidividual toward more system-blaming! explanations ot 
ineijuities and, correspondin^il) , Irotii internal toward more 
external cofitrol idci)lo*!ies. The) also iticreased their pre- 
ference for collective action i>\er iiKlividual mObilitv as the 
wa\ to deal w ith the system. The ideoloiiy of black nationalrsii] 
displaced inieuratioii as. the maior frauK* of rctciLnce for the 
students' convictions rhrouuhout the countrv black students 
were nu>re active than white students in both the civil rights 
;ind the collet!e eovcrnance siruc-Liles. and the students in 
the colleties Ciurin and l-pps studied [nuticipated at these same 
hiiih levels. Still, .some of the students participated more than 
others, while some did m>t pa'' ipate at all. Thus the authors 
ask what variables correlated with student activism and black 
nationahsni. 

Of fi\c demoiiraphic variables examined - rural or urban 
location of the student* s home. fanul> income. Tamil) 
sTructure, the importance of reliL!ioiv in the family, and the 
level of education attained by the father and by the mother 
the first was decidedly more inlluentiat than any of the others 
Students from farms and villaiies with populations of less 
than 2fii)() panicipated the least, while those from cities with 
populations of more than l(K), ()()() participated the most. Phis 
was found in 19f>4. in I96S. and ai!ain in M>7(). It applied 
most stroniilv to civ il riLihts participation, ami in lesser decrees 
to student power and black oriiani/ation activity. Interview 
data suiiiiested that it was not simply a conservatism of beliefs 
that limited the participation of student-, trom small towns, 
but also a lack ol oppi>nunity combined with a fear o\' re- 
prisals aiiainst the students* families. Indeed, rural students 
attendini! colleiie in urban sites were found to participate more 
in civil riiihts activities than urban students attt^ndinu college 
in rural sites. thi>uiih less than urban students in urban sites. 
Gurin and Hpps use this and related data lo ar^iue ai^ainst over- 
psvcholoiii/ini! of the question of black students* participa- 
tion levels. 

Students from more rural orii:ins did. especiallv in 1970: 
express **the most' individualistic, conventional views about 
success in our society;' they also continued to accept traditional 
administrative authority at much the same level that was 
modal in 1964" (p. 253). The shift in attitudes between I9M 
and 1970,, then, did not spread evenly across the South, 
but occured first in more urban locations. The other four 
denioiiraphic variables^ however, maiie almost no difference 
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to siuilcnt.>' idei^K\ii\ , w liil- only family income and parental 
education intluenced participation, and these to a lesser deiiree 
than has been commonly supposed by iieneruli/ini: from 
studies of while students' activism. 

(iurin and Kpps examine the relalionship between 
ideoloiiy and participation and find that participation was 
as>ocialed with more external control ideology, with blamini: 
the svslem more than blaminii individuals for racial inequities, 
and with commitments to e(>llective action, ihe relationshi[) 
is not necessarily as simple as this implies: in at least one 
collciic there was evidence that the participation led to the 
sustaininii of ideoli^izy, rather than just the other way around. 

That personal control was generally noi related to 
:»cti\ism emerges at this point. The original factor analysis 
of the Rotter scale is now seen to ;lea\c the wh(^le problem 
into [wo nearly symmetrical parts. Personal control was re- 
lated to individual achievement, but not to activism: control 
idecJoLiy was related to activisni, _,but woi to individual 
achievement.. The one exception to the first part of this 
formulation is a tlndini! that the students who were most 
eiiuaued in civil rights activities in !9M combined internal 
person al control with a highly external control ideology. 
This almost mirrors the exception to the second part, that 
students w ho Ciimbineil external personal control with internal 
control ideoIoi:> ranked I(>west ii] individual achievement, 
(iurin and Epps einphasi/c that an ex tenia I ideology serves 
positive functions that have been, ignored in much of the 
thinking about locus of control. In relation both to individual 
achievement and to activism, external ideology can be seen 
as a reality orientation for blacks, rather than as the passivism 
or alienation that externality has generally been' taken to 
represent. 

Jndividua! vs. Collective Achievement? 

Was it possible for students to integrate individual 
achievement and activism This question opens the concluding 
section of the book. Gurin and Hpps tcli how, their own 
hopes aside, they expected indisidual achievement and 
activism to be polarized. They quote from a speech Stokely 
Carmichael made at one of the colleges* they were studying: 

One of the things that you are going to liave to do 
is realize that Black people, especially in the colleges, 
can no longer afford the luxury of being an individual. 
We must see ourselves as a pei^ple. We can no longer 
accept that which \<hite society calls success because 
to be succe.ssfLiI, for Black people, in this counir>' 
is to he anti-Black. (Ciurin and Hpps, p. }4}) 

(lurin and F.pps*s data do not seem to fit Carmichaers 
c(Miclusion. The two sets of conimitincnts - to individual , 
achievement goals and to activism and .social change - were 
repeatedly unrelated. 

L.et us be more specific. We pt)inted out in Chapter 11 
that grade pcrtbmiance in college, as one indicator 
of individual achievement, was not related to activism. 
The independence of collective and individual ciMiimit- 
ments went tlr beyond that. We checked whether 
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acilvisls and n;Miaclivists asptrci! li> ditTcaMU cdiu atinnal 
and occupa'iional uoals Wc examined ihc individiuil 
uirals ol aclivisis and nonaclivisis in M^M and in l^^7(). 
Wclcxplorcd whether ihe ivpe aelivisin in M^^O 
iiialiercd as lo ihc ease with whieli siudenls handled 
personal and ciilleelive Ciininiiuiienis With nnly tuD 
exceptions the results rcpealeill> slinwed lhal hiuh 
aspirations and pcrfornianee jusl as oflen eharaeieri/cd 
the activist as the nonaetivist siudcnl no more, 
no less. Individual and eollceiive eoniniitnients uenerall> 
were not polari/ed. nor were they eom[>lcmentar\ to 
each other. Whether students enizai^ed in one said 
noihini: about their eoniinitnients or ac tions in the other 
(p. 34f)) 

This is a stunninii finding!, lor this reader the most un- 
expected in thf hook. Cuirin and fpps follov^ it with an 
analysis of tour groups of student amonii the seniors in 
the six. college; eross-seetional study ot i^^O and the longi- 
tudinal foliowup ot" seniors at one college in M^^iS: students 
they classified as Individualistic Achievers. Committed 
Achievers, Activists, and Unengaged, [hese groups were 
derived by first distinguishing between the seniors with un- 
usually high individual aspirations and the remaining seniors, 
and then . identity ing within each ot these groups the seniors 
who had- been involved in civil rights or student power 
activities ahroughoul their college years and those who had 
never been involved in either of these types of activities. 
About two-thirds of all seniors in the two studies tell into one 
of the four resulting combinations. 

Up lo a point, the characteristics of the seniors in ttiese 
four groups matched what the earlier findings predict. Ihe 
students came to college trom much the same backgnninds. 
the exception lo this being that the Unengaged more often grew 
up on famis or in villages, and that fheir lathers had attained 
less education than the fathers of the other students. The 
Individualistic Achievers and the Committed Achievers ex- 
pressed stronger personal efficacy, less anxiety about tests, 
and stronger convictions about their own academic com- 
petence and ability to succeed in their tuture occupatitinal 
roles. The Committed Achievers and the.Activists more otten 
blamed the system than individual blacks foi racial inequities, 
rejected traditional work-ethic explanations of success, sub- 
.scribed to political nationalism, and were critical of tiaditional 
governance of college life. The four groups did not ditTer 
\n their college grades, a tlnding that seems to retlect an earlier 
inference that the seniors with less sense of personal et- 
ficacy and academic competence and with higher test anxiety 
were more successful in coping with these feelings than 
students who had dr^^pped out by this lime. Finally, men and 
women were found in equal proportions in the four groups, 
a fact that is more difficult to reconcile with Gurin and Bpps*s 
earlier findings. 

The authors pursue the aspirations and motivations of 
the four groups to still funher depths. They t1nd- that the 
Committed Achievers more often expected to enter pro- 
fessional schools, whrle the Individualistic Achievers looked 
more to Ph.D. programs. The Committed Achievers and the 
Activists alike expressed stronger social commitments through 



their occupational choices, though, curiously, the Com- 
mitted .Achievers chose lavv and medicine almost lo the 
exclusion of other occupatii^ns. The Committed Achievers 
iw the longitudinal study finished their senior year with strong- 
er feelings of personal con\petency than the ;>Iready strong 
feelings of self-conTidence they lind. expressed as freshmen. 
In this they weiv alone among the loij^ 'tjoups. 'Hie Indivi- 
dualistic Achievers maintained a conventionality^ and opti- 
mistic acceptance of the social order, while all the oilier groups 
in the longitudinal study, even the Unengaged, left college 
•'much less individualistic and conventional than when they 
had entered** (p. 3fi3). Again, the Activists, alone of the 
four groups, left college with lower ■ occupational aspira- 
tions than those with which they had enlered. 

Does this last finding signify that individual achieve- 
ment .'.lid ictivisni might have been irreconcilable in ways that 
the a.nalysis failed to detect'.^ Gurin and Iipps acknowledge 
that the issue is coniplicated,^but nonetheless present data 
to support an alternative interpretation. 

I'he Committed Achievers, and only they, stood oul in 

both 1908 and 1970 for; 

contact with more faculty outside .the classoom. 
greater use of faculty in planning for the future, 
tinding these taculty contacts more helpful, 
belonging to more campus groups, 
holding more leadership positions on the campus, 
participating especially in more governance com- 

iiiittccs and Afro-,American groups, 
identi tying' more often as student leaders and less often 

as casual types, 
participating more ot len in at least so. iie Black- 

oriented events, especially those concerned 

with the politics of .Africa and political na- . 

tionalism at home. I p. 303) 

;>nTc authors argue that the Committed .Achievers were 
siinplv more successful than the Activists in integrating 
personal and collective achievements. There was nothing 
different between the activism per se of the two groups. 
Rather, the quality of their campus experiences seemed to 
acciHint for the divergence of these groups. 

Ot course, we do not know how the Ct'mniilled 
.Achievers developed these ties. It is nard lo argue 
clear-cut effects from these data, and it is far too simple 
lo urge the taculty h> '*Ho something" about the other 
Activists. Most students, not just Activists, probably 
wtiuld benefit from closer ties with the faculty. The 
Activists needed something — faculty models, success- 
ful leadership, social experiences — to help them pul 
it all together, as the Coniniilted Achievers had doiu. 
(p. .Vi6) 

This review has summarized the findings ol htc Gurin and 
F'pps book much more extensively than is customary. 
Because of the complexity of the b<iok. its argument might 
otherwise be inaccessible to many readers. l or this reader, 
at least, it has been necessary to think through the book in 
writing in order to understand it. That the authors a'c a white 
and a black has clearly sensitized this research to many issues 



15 



and facis lhat niiiihl have escaped a white, and pussihiy 
• a black, scholar wor^ini: alone. One is simck. iVir example, 
S'^by a comparison between the present hook and Sean/oni's 
The Black Family in Modern Society (1M7I). Svan/oni's re- 
search is exemplarv- ^ its identification of the poj^itive 
functions of black piirefrfs in thc^ iiphnneini: o\' their children 
It argues quite as directly as 'he Gurin and l:pps research 
that the individual admirations and achievements of hlacks are 
formed within, let us say \>\ the mles of. the American system 
and its discrimination against minonlies. Ail this notwith- 
standing, Scan/oni docs not illuminate, indeed barely attends 
to, the relationship between blacks' individual or familial 
striving and their larger collectivity. His sample ^as drawn 
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from Indianapolis in \^)M, which on account of bcBi the year 
and the urban location shcuiid have lent it to deeper probing 
of political orientations than Scan/oni reports. One felt it as 
a failing even bef(^re the publication of Gurin and L-pps's 
research, and now one's questions are nui It i plied. 

- ' Is it that students are especially sensitive to the issues 
Gurin and Epps exph^re * At the least, the research is in many 
ways a remarkable collaboration between the scholars and their 
subjects. The interviews quoted in the book conducted by 
black students a few years older than their subjects, 
particularly testify to this. 

One wishes that a follow-up of some of these same 
subjects would'be conducted in this decade, to ascertain how 
they made the transition to their occupations and piistschool 
political activity. A definitive answer to the basic problem 
Gurin and Epps have delineated cannot be kniSwn until the 
later phases of these youths' development have been studied, 
using the tools the' authors have asseinbled. if not still more 
powerful methods of analysis. Even then, however, one might 
not be satisfied Not uriril discrimination against blacks has 
been effectivelv ctHjnierDd can we finally know how individual 
and collective achievement weigh in the balance pans ot 
justice, 
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